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“thda paper ‘pints out; thet “the puzzling nature of the’ evidence a 


a , pegormance 4 is. due at ‘least 5 part to: the research methodology cael to - 
“ gtudy this relationship, in particular to the use of ee eer data. 

= | 
on teachers, With ctoss-sectional data, the ‘variable of. interest, years. 


+ of teaching experience, reflects three.different phetonenn: ‘learning, by - 
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| doing, vintage, and ‘Selection. | We explain these phe omena. and indicate 


| observed in a cross-section of teachers. We then shor how explicitly’ 


" ‘taking into account one oe the , actors, vintage, ‘hag a marked impact on 


s . 


- oe the relationship between teaching cixperiente and. teaching | ie 
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e and performance 


7 a1. ‘INTRODUCTION — : ae 2 - : >. % os : : Fes .. io 
a . ce . The guestion of, whether teachers become more aeeduetive as they gain a 
- + eaching ¢ experience has been of interest, to. policymakers for many years, & Se 
Oona ‘reason is that. schools serving children fron low income families have = 
ade typically ‘been ‘staffed with less experienced teachers: than schools serving , a 
| ce , . class children (owen, 1972). | ‘this. has led. to court tests of. whether 
7 i the: uneven, ‘distribution oF cesciiiing’ exper ence constitutes discrimination 
~Vagaingt 1 low’ incoue ‘children. (Hobson y.- Hansen, 1967). 


— Unfortunately, efforts to model and est inate the relat ioaship between - 
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teaching” experience and teaching performance have not ‘been, very helpful to 
|. policymakers. and the courts. Despite a ‘growing nunber of studies, the. 
evidence nenains Anconelusive. Some educational product ion function a 

| studies’ report significant positive relationships between teaching -*, 

" #3 experience and teaching performance, as measured by student achievenent 

2. gains. (Hanushek, (19725. Mutnane, 1975). . Other studies ‘report no ‘significant . 

| relationships: (anughek, 19733 Henderson et al., , 1978; Link = Rat Ledge, mann 
as) se ree | | 7 | 

: This paper points: aut ‘that the: puzzling nature af ‘the evidence’ is “due 

noe least in- pert to the research methodology used, to study ‘this | | | 
AeLattonship, in, particular to the use of” cross-sectional data on teaghers. 


an ‘cross-sectional data, the variable of . interest, years of teaching 
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. THREE FACTORS INFLUENCING THE EXPERTENCE-PERFORMANCE imartovsute: =o 
en Sete ke Learnt b = - an ae iy _ ao oy oS 
; ce * . The hypothesis that teachers: become significantly more. effective - 

ae ‘as they. gain experience, rests on the view that teaching isa couplex 2 | 

ba of - proches requiriis, a varied set of skiite, many of which can. only | be 

= et . Learned on ‘the job, In other words, " eaaciens learn to ‘teach by 

. ed ‘teaching, and a5 a result, they’ become more. éffective as they acquire - - 

i experience. The tmost straight ebrimrd: way to: investigate the impact | 

| of Learning: by doing on teaching performace 1 to examing the 


oo oe | effectiveness of individual teachers over erred To date this apeateny | 


mote. + ok ie. 2 we 4 Soe 3 a 
| a ie has not ‘been pised. | 7 % Pg - a. 7 a 4 
ees _ Instead, the tole of Learning by doting b has been. investigated by Oe de 


“eatinat ing the relat ignehtp between, expérience and performance in a 
cross-section of: teachers. It ‘has been ‘tmpltedtly aacuned, that 4 
~ imetuston ‘a: the motes af aha aia on. the background and eehining 
’ vs éach peachey accounts for ‘differences in. the effectiveness of 


there 


- —elichere due # to factors other than learning by doing. | However, 
- are good. reasons why: sighiticant unobserved asf ferences in the innate 
talents of teachers with different levels of experience may exist that 
‘lead to bias. in the eatinatied impact of Learning by doing. “These 

‘. 


| oo 4 erences can be characterized. as vintage « and selection effects. F 7 
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i hee os «Bs Vintage Effects 4 a _ fo ae peas 
. 4 44 oS .. ‘Vintage effects are ‘defined as. diterncd in the average. 


a a 


aba iedes of ‘teachers hired by, school districts at different points a 
PTS 4. Sh aa rt 

ee", eine 2 The most ‘compelling explanation for. the existence: of vineage 
ce Paes effects is that dramatic changes in labor market conditions for, a 


- peactiers over the ‘Last: twenty-five years. have a dtfectes the quality’ of” 


mew entrants. to ‘the ‘teaching profeséion. “In ‘thet late 1950's andi early” 


. Sg 


Tee us 1 1960's; 4 | rapid increase in. student enrollments created an acuté ae 


| shotage of teachers, in the United States. any’ séhoot dteteseee,. 


acy particularly uzbas, districts; found- te aistieult, to, “find” ao 


_) eininatly qualified applicants, to fill. vacant, Pd detons. ay ‘1970. this ” - 


situation had changed ‘atgndfipantly~ Die tothe combination of a Syed 


_ decrease in the: demand for teactiers precipitated by: declining. 


enrolimenta and an. increase in the supply of. teachers fa delayed 
~ response: to ‘the earlier shortage) , there has been a eurplue of \ 


: "teachers dn most subject, areas during the 1970's. As a result, ‘achool 
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Hatrtets have: been’ able to be. ‘very selective in choosing ‘among the ne 


large number of spplicants for teaching “positions. Ascuntig mee 


a “aaatrce perscinel officers, are able. to ident fy spplicants with, ghe pa% 


greatest potential, the ‘average quality. of new teachars, should be 
-whigher, ta'periods of” excess ‘supply, such as the 1970's, than, in. =e 
- periods of excess demand, “auch as the early 1960'9.2/ Unless. the | 


“differences “in the average abilities of teachers. are yeeereees by 


variables describing teacher backgrounds Guten is very dagficult to .' 


do), chess differences will confound the estinate of. the a toast of, aa 
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“Selection ettects” are defined as differences, between ‘the average 


abilities of teachers of a given experience Level who choose to fenain 


classroom teachers and. those who choose to leave classroom teaching. =e 


7 There are a varinty of nechanisns which could create eit, 
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- gelection effects. i efample, the nore effective eee 
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. ‘teachers ‘aay Leave elassroom te becbae aduinistraters: 
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it may be only't the most abi firet year teachers who survive the | 


~ ddecipline problens. that: plague new teachers. vie. selection effects 


yo 
euch as ‘these result ‘0: ‘the best, eopprienced ¢ teachers leaving the : 


~ classroon, and. ‘the best inexperienced teachers xenaining in the! 


classroom (until they. acquire enough. experience to: becoine | L 
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~ and performance, ‘for a cross-section of teachers will inderest inate the 
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mo impact of ‘Learning by doing. - 
_ . Another ‘source of selection is that many teachers leave the 
| élassroon to’ take positions in professions. in which salaries do not - 
- depend on degrees and. aie Effective teachers may ‘be the most 
- Likely to leave since their teaching ability may. reflect skills valued 
7 in other professions. Without imowing how many years teachers are 
| Likely to spend in the classroom before evAtenng professions, it is 
. -not possible 6 infer how this. selection mechanism affects the | 
= , observed. relationship between. teaching experience and performance. 
| We conjecture, that. many of ., the’ inconsistencies ia the ‘educational 
. production funct don: literature concerning the ‘relationship between 2 
Reaching: experience and teaching performance. are due to vintage: and 
select ion effects, the direction and ‘ingndtude of watch “depend - on he | 
‘date at’ which the data were collected and on. » the hatory of labor’ 
7 market conditions, in the sample area, Tee 
| "Unfortunately, with the data available to us” cs to. our | ; 
. oe knowledge, to any other’ researchers), it fs not. posedble to exam 
“the: role” of selection. effects. : However, using micro: ‘data on tea 


ih one large urban school Aistzter, it. is poseiits to construct a : he 


- o&. 

: ‘next “section deedbieatin data base ms the variables used | to! 
“indicate learning by doing and ee effects. 4 2 ©. 
mr. DATA AND. MODEL, a | | | 

| The data used” iq this study « consist of information’ on. esis and ° 


teachers tn a large city in the Midwest in the mid 1970's. AL of the 


sie children are black children attending the: third or pours grade in inner. - 


| “Gg achools.2/ Ninety-three percent, of the tédchers are black. The data 
“iuve the following ‘desirable attributes: = 
—_ 1. The unit of observation is t 1e tndividual child, 
ng 2. Longitudinal in format ion on. each child's achievement is used, The 
| measures of achievenent are scores. on the vocabulary, subtest of the 
Towa Test of Basic Skills. Scores 8 are. avatlable soe successive . 
school years for gach child. | . a 
3, Detailed data on each child's hone cxvironnent, ‘including fantly | 
income and number of siblings,” are included, a 
ue : 4, Each child ‘is matched ‘to his or. os individual classroom teacher ts 
: . 3 merlate 0 on each teacher include informat ion on ‘praining ve | 


. experience as well as'the date at which each teacher began to work. 


a t. - in che school system. | a | — a 2 ' 


| “The prinary hypothesis tavest igated ia, the expirical vork is that, ae - 
explicit analysis of vintage effects. will increase the estimated. tmpact of . 
e dearning by doing. The vasastd used to indicate ‘vintage erttets ts the pa 

i. change in total eee enro nts in the district between the year in. 


"which he teacher ‘first tqught in ‘the digtrict and the previous year. ‘The 
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“logic underlying. the usd of this variable is that. in years ‘of rapidly 
growing student enrollments, this, district and neighboring districts 


; compet ing. for teachers in the game pabor market hired a numbers: of. 


; teachers at a tine dn. which the “supply ‘of f tegchers. was relatively, 


+ 


Limited.” ‘As a ‘result, they. could not be selective in choosing among 


applicants. ; When enrollments were: decliaing, personnel sttickss 9 gould t be: 


“ 


~ ere: selective ‘and average teacher quality. would rise. This logic led. to , - 
_ end second hypothesis:. namely, that the coefficient on. the variable =: ae 
. | ‘measuring changes in student enrollments would. have a negative sign, - ; : / | 
indicating chat teachers hired when earolinents were growing would be of ae os 


oa 


yrs | lower average quality, than teachers hired in cic s of. declining 
+ Grotiminte, Huu 8 eek _ : ean 


The variable included in the nodel, to: “indicate Leartiog by doing was” — 


. ‘ 


the natural. logaritin OE each teacher’ 's total ‘number of \years of teaching 


; ‘experience, | This specitidation reflécts the: aséumpt ion that. teachers - 
gti -comtdnue to. ae as they gain experience, but that the greatest saine . 
ale _ from additional experience occur in the first years of teaching. 


It is. important to. note: that. the sample contains, teachers hired over: 


— | the thirty year period from the early 1940's to the early 1970's. As 


¢- indicates, there were wide swings . in enrollments 


| Table A-l in the appen 
| 7 | oe | afring this: period. During the ‘1940's, student enrollments were relatively 
7 8 ' mane: Enrolinents grew rapidly during ‘the 1950's and more, slowly during: a: _ . 
. the 1960's, reaching a peak in 1968. “After 1968, student enrolinents - | 
decreased steadily. The nonmonotonic changes in student enrolinents he 
created a significant anount of independent variation between the variable 
‘indicating vintage effects and. the variable indicating, learning by desig. . : 
. -Aucther variation was created by the face thet more than 15 percent “of the. 
teachers had Fang in other school. systens. For thege teachers,, the total 
number of years of teaching experince was. not staply- equal to the : r = : ~ | 
. “difference between: 1975, the date gen the “_ were collected, aod the os 


: j 
: ae os : : : a < \ air . ¥ 
og pa date wid cm teacher was ‘hired by a school aysten, Asa pesiilt: hes these . 
. ‘factors, the zero ‘order correlation coeftictent between the variable . ‘ Wiad 
i too6 . indicating vintage effects and the ‘variable indicatigg learning by. ‘doing ae 


wes only, 0. $1. This was. sufficiently low to permit peparate est imat ion of . 


S , 3 | ‘the impacts, of learning” by doing and vintage agects’ on teaching : 
, ue performance, Gs measured by. the. achievenent test gains of student gh i - ; 
| : = These coefficients were estimated in the gontext of a Linear. model | ee | 
. with ‘the following general torn! i | : 
| os : ales a, + rhs et eat + It nin +e, + wv, + Uy - : : | @ Wes : 
a + ve - = the achievement level ‘of the ith child at the end of school — . 
year tL “ae a o 3 | 
Ay eal = = the Wohteventne 1 Level of | the ith child Pr ‘the end of school # - oe 
| year tel ra | 
ay , the. ‘jth characteristic. of. the ith child « or his tanity 
/ oF 7 - = Tin ot ‘the nthe characteristic of the ‘ith child's teacher (excluding 
| . . 7 = : experience) a = = . ye Ge | 
po BE, ie! Natural ‘logarithm of the number of - ‘yeas ¢ of € experience of 
: r - a2 the ith child's teacher | _ . 3 - . i 
| My ) ss = total student éarolimente in the schogt aysten in the year | 
: , “in which the ath. child's teacher first: worked in the systen | 
us * minus ‘gtudent eorolinents sal the previous year eG . — a 
| u a a ddpturtance | term t ‘that, he a zero ‘mean and. constant. = 
i z 62 rata Summary statistics describing a distributions of the ‘variables included ‘ os 


tf ma fa. the wodel are presented. in table a? of the eppendix. The model was a : 


: stanated using drdicaty 1 Least speraas = 
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“As Colum. 1 of Table 1 “indicates, when the impact of Learn ing by. doing 


: was’ ‘estimated in‘a. model that ‘did not napelas an indicator. of vintage 


“effects, the estimated conffetent | was s positive, but hot ‘bignzftcanthy,_ 


- . . eet, Sete; ey! . 
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‘,, Insert ‘Table 1 


. However, as ; Column 2 indicates, when the indicator of vintage effects was 


: included in the model, the Ampact of Learning by doing. sore, than doubled, 


rade equivalents, implies that childrey taug 


y: nd the estimated coefficient was aignificantly different from zero at: the " . 


4.0L level. The size of the estimated cosffici ty when trans: Eed into 


by a teacher, with five 


years ‘of experience make three to four more months of progress in acquiring 


reading skills durths a school 'year than do children. taught iby a first year 


: when. t ppptage effects aré explicitly taken inte account .— 


. ‘cht second ypothests: th 


* 


teacher. This, the estimated results proyite support for eee first ae 


hypothesis: that the effect of learning by ome becomes. more » pronounced 


Ue 
~ As Column 2 ann empirical’ resuits. also provide support for oa 


the confficipit ‘indicat ing the amp ace: of, ‘ é 


i vikege effects would be: negative and significantly different ‘from zero. « 


‘Thus, the renijts indicate that ‘Learning by. doing and vintage effecte are | 


 . both significant determinants of the quality of the teaching stats. “in ) - 
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_ large urban: school district. 1s | —_ . poe * 3 oo ote 


ae , ore Soa = : 
i Se eae ee 


If the relationships ext inated in ‘this model continue | to hold in ee _— 


2 ‘future, teachers hired in the adit fev yeare ‘shovlld be of high average 


E ; ee quality.” The’ reason ts that enrollnents will continue we fall | over, ‘the 


we. 
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) : fo : 7 - Table 1 ne | _ “6 4 a ° oe _ ; : —- 
“ESTIMATED ‘PARAMETERS OF EQUATION 1. 


aa : eee. of, “Andicates significance on a Sh. two-tailed t test.. 
3 uF ; nt, wee ; * : 


a oa ese +n "indicates ‘significance « on’ a: 1% two-tailed t test.- , 7 _ #y 


me Pe : . eo og OP gs 8 2 ie ce ee 
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: a. ao . Indicator of Vintage Effects a ‘ ‘ * _ a 3 an , ee, ‘ 
" )” "Student enrollments (in hundreds © = wk LR 
of students) in. the school ‘district ~~ ar . . (-2.70)_- , 
-; 4m the year in which.the teacher. - a ee ee 
' began. work in the district minus j= § oe ae 


- gtudent enrollments (in hundreds | 
» Of students) in the previous year 


Teacher. Characteristics : 4° 


. | " witural oe 60 the total cmumber. "4203. 25,6548 
Doo. Of years of teaching experience © +. (1.39)°-. - .- (2.58) .. .: 
We, alk ” Gindicator of . learning. by doing) ae Pes a 
ae 3 aa Holds master! 8 degree Swe 76.72 re ae , 
7 a er ~~ w= (-0.76) ‘(-0.33). ae 
Attended nate college = 210.15. 22,52: | 
ce Ga08) (0426) 


‘Teacher is mle + == 0.02, {BT byt” & 


he ‘ . 2 Teacher is white - eS 8 ee 5.19. - | 7 - 6. 30 z 
ae 4 a 7 : os oo (0.25) a 7 ~ (0.21) < 
4 ; bod a , : a - 7 y ed , 


Student. Background Characteristics aoa >. i oe s : a 


thie is sale ee. ea . ad gga | 24.19%% 
| (Q. 86) Ty (3.06). . - : 
* Current’ ‘family ‘income oe yd a . 0.02. ~~ Qo1 - 
: ee ra eS Is, + (0.97) . 7 (0.88). 
~ Student's age: a oe fo oe AT 8.63 7 ; | > 8.19 
ed Se 26) CHE 20) 


“‘Hougghold hefd-is female > oy rr © ee 
a 2 ee oe 0.70), (068) 


eee Bee ae 


“#.°. , Number of “children in thejfamily. 4.018 aa. are 
ae te og oP ae ae 6 GRO) =. Cae ee tS 


a ~ 6:7 Aes ; 


Achievement: Lavelcf phiid tn’ thar: 0. 7588 . 
(12.01)... 


grade: at and of previous: year "a2. 01). 


“ idohtevenent? aetior child jas 
fourth grade é at Jénd. ‘of, previous’. 


ay Seperite fatercepts werg, exceed for children ie sa 3 and 4 


it the 1973 and “197, school year.” 2 
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a “ext five pears \etil personnel officer’ ‘will be able. to > select the fey 1 new ; a eg 
- feachers needed from’ a large pool of applicants. XY is important to been in’ 


- mind, » however; that the indicator of r visitage — used in our model | 


. measured. by, sat scores relative te the national mean)” This, decline is. ee 

cr su é Sto. che’ response. of college students to’ the: labor market’. | 

re °. : 
‘conditions for* teachers and partly: due toa lowering, of standarite “yy 


. | teacher training prograns. = =, of 8 ee re ee? eee oo 
ee see ar) ; : ‘ : ‘ : Mas ; 


a . Given the. disequilibrium in the labor market: for teaghera; At is not _— 
ee io 
~ ee clear to ‘what extent the decline in the. average ‘quality: of the: applicant 


7 2 ; pee will affect the quality of end teachers, wi who are actually hired ; = a . fe 
 . suraly, ehend is a wide distrtnuttod of talent in the applicant pool. tf : : | 
vo the most: talented applicants % are hired to fill the relatively few. teaching - uf ; 

| positions that wil be open -in the soning years, ‘the: quality will, be. high ian: 


Se i 


despite the decline in the average. qality of the pool. However, the = 
" actial chodke of applicants from the pool: will depend on the. extént — — 
7 which high quality applicants: can ‘signal their ability, and on ‘the: extent : Pe 
to which: school district peradnnel officers have the resources, “‘gkills, and 


8 4 : 


e a 7 known about school. district ‘hdring oo in periods of Agbor narket - ee 


: pre, ’ ; - incentives ‘to find ‘the alentd ‘Abplicante. Unfortunately,” very little is 


age 


me cf * ateequttsbrian. yr ve oe a er a i Se. oy 
ie a - oS a — - In conetusiéa, we ait argued ‘that two “factors elated ‘to. labor narkat_ a 
| _fovdtetione for. ceacherenosatage effects and selection » affecte—inéluence - <a _ 


ue 


‘i _ - 
-@ 


i % she aqvaltey of the teaching staffs ia ‘American schools. These factors ° = 
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ae : Ws otal student eaceliaenty. in. the: urban‘ ‘schgol a os. 
: | | provided the data Hor. this snalysis. oe 
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& oe es 4.36 
a re (5.96) 
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_ Naturd] logarithm of experience 7 
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| Holds master’ 8 degree a 62.46 ee tke cr a 
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‘Teacher‘is male ne Yi ro 
, oer ae dswhite pS 6.00 
« Indicator of Vintage Effects! : ia . : oo a — oo ei 
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vse.” . the year in which the teacher began” tt . a a oar 
“"  . wprk in the district minus. student. i ee rn 
ete, Os , enrollments: (in hundreds of sree ao 1 i. sf 
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. by All of the means and. standard deviations in. a Table cams were. calculated. 
2 _ ~ “ Eping the spunber of student obsérvations as weights. The numbg o of | 
| ‘students appears ‘snail relative to the — of Peachatss:. ‘The = 
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